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(57) Abstract: A processor such as a multithreaded hardware based processor (12) is described. The processor (12) includes a 
computer instruction (20) that is a branch instruction that causes a branch in execution of an instruction stream based on any specified 
value being true or false. The instruction also includes a token that specifies the number of instruction of instructions following the 
branch instruction to execute before performing the branch operation. 
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BRANCH INSTRUCTION FOR PROCESSOR 

BACKGROUND 

This invention relates to branch instructions. 

Parallel processing is an efficient form of information processing of 
concurrent events in a computing process. Parallel processing demands concurrent 
execution of many programs in a computer. Sequential processing or serial processing 
has all tasks performed sequentially at a single station whereas, pipelined processing has 
tasks performed at specialized stations. Computer code whether executed in parallel 
processing, pipelined or sequential processing machines involves branches in which an 
instruction stream may execute in a sequence and branch from the sequence to a different 
sequence of instructions. 

BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. 1 is a block diagram of a communication system employing a 

FIG. 2 is a detailed block diagram of the. 

FIG. 3 is a block diagram of a microengine used in the processor of FIGS. 

FIG. 4 is a block diagram of a pipeline in the microengine of FIG. 3. 
FIGS. 5A-5C show exemplary formats for branch instructions. 
FIG. 6 is a block diagram of general purpose registers. 

DESCRIPTION 

Referring to FIG. 1, a communication system 10 includes a processor 12. 
In one embodiment, the processor is a hardware-based multithreaded processor 12. The 
processor 12 is coupled to a bus such as a PCI bus 14, a memory system 16 and a second 
bus 18. The system 10 is especially useful for tasks that can be broken into parallel sub- 
tasks or functions. Specifically hardware-based multithreaded processor 12 is useful for 
tasks that are bandwidth oriented rather than latency oriented. The hardware-based 
multithreaded processor 12 has multiple microengines 22 each with multiple hardware 
controlled threads that can be simultaneously active and independently work on a task. 



processor. 



1 and 2. 
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The hardware-based multithreaded processor 12 also includes a central 
controller 20 that assists in loading microcode control for other resources of the 
hardware-based multithreaded processor 12 and performs other general purpose computer 
type functions such as handling protocols, exceptions, extra support for packet processing 
5 where the microengines pass the packets off for more detailed processing such as in 
boundary conditions. In one embodiment, the processor 20 is a Strong Arm® (Arm is a 
trademark of ARM Limited, United Kingdom) based architecture. The general purpose 
microprocessor 20 has an operating system. Through the operating system the processor 
20 can call functions to operate on microengines 22a-22f. The processor 20 can use any 

10 supported operating system preferably a real time operating system. For the core 
processor implemented as a Strong Arm architecture, operating systems such as, 
MicrosofttsfT® real-time, VXWorks and DCUS, a freeware operating system available 
over the Internet, can be used. 

The hardware-based multithreaded processor 12 also includes a plurality 

15 of function microengines 22a-22f. Functional microengines (microengines) 22a-22f each 
maintain a plurality of program counters in hardware and states associated with the 
program counters. Effectively, a corresponding plurality of sets of threads can be 
simultaneously active on each of the microengines 22a-22f while only one is actually 
operating at any one time. 

20 Microengines 22a-22f each have capabilities for processing four hardware 

threads. The microengines 22a-22f operate with shared resources including memory 
system 16 and bus interfaces 24 and 28. The memory system 16 includes a Synchronous 
Dynamic Random Access Memory (SDRAM) controller 26a and a Static Random Access 
Memory (SRAM) controller 26b. SDRAM memory 16a and SDRAM controller 26a are 

25 typically used for processing large volumes of data, e.g., processing of network payloads 
from network packets. The SRAM controller 26b and SRAM memory 16b are used in, 
e.g., networking packet processing, postscript processor, or as a processor for a storage 
subsystem, i.e., RAID disk storage, or for low latency, fast access tasks, e.g., accessing 
look-up tables, memory for the core processor 20, and so forth. 

30 The processor 12 includes a bus interface 28 that couples the processor to 

the second bus 1 8. Bus interface 28 in one embodiment couples the processor 1 2 to the 
so-called FBUS 18 (FIFO bus). The processor 12 includes a second interface e.g., a PCI 
bus interface 24 that couples other system components that reside on the PCI 14 bus to 
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the processor 12. The PCI bus interface 24, provides a high speed data path 24a to the 
SDRAM memory 16a. Through that path data can be moved quickly from the SDRAM 
16a through the PCI bus 14, via direct memory access (DMA) transfers. 

Each of the functional units are coupled to one or more internal buses. 
The internal buses are dual, 32 bit buses (i.e., one bus for read and one for write). The 
hardware-based multithreaded processor 12 also is constructed such that the sum of the 
bandwidths of the internal buses in the processor 12 exceed the bandwidth of external 
buses coupled to the processor 12. The processor 12 includes an internal core processor 
bus 32, e.g., an ASB bus (Advanced System Bus) that couples the processor core 20 to 
the memory controller 26a, 26c and to an ASB translator 30 described below. The ASB 
bus is a subset of the so called AMBA bus that is used with the Strong Arm processor 
core. The processor 12 also includes a private bus 34 that couples the microengine units 
to SRAM controller 26b, ASB translator 30 and FBUS interface 28. A memory bus 38 
couples the memory controller 26a, 26b to the bus interfaces 24 and 28 and memory 
system 16 including flashrom 16c used for boot operations and so forth. 

Referring to FIG. 2, each of the microengines 22a-22f includes an arbiter 
that examines flags to determine the available threads to be operated upon. Any thread 
from any of the microengines 22a-22f can access the SDRAM controller 26a, SDRAM 
controller 26b or FBUS interface 28. The memory controllers 26a and 26b each include a 
plurality of queues to store outstanding memory reference requests. The FBUS interface 
28 supports Transmit and Receive flags for each port that a MAC device supports, along 
with an Interrupt flag indicating when service is warranted. The FBUS interface 28 also 
includes a controller 28a that performs header processing of incoming packets from the 
FBUS 18. The controller 28a extracts the packet headers and performs a 
microprogrammable source/destination/protocol hashed lookup (used for address 
smoothing) in SRAM. 

The core processor 20 accesses the shared resources. The core processor 
20 has a direct communication to the SDRAM controller 26a to the bus interface 24 and 
to SRAM controller 26b via bus 32. However, to access the microengines 22a-22f and 
transfer registers located at any of the microengines 22a-22f, the core processor 20 access 
the microengines 22a-22f via the ASB Translator 30 over bus 34. The ASB translator 30 
can physically reside in the FBUS interface 28, but logically is distinct. The ASB 
Translator 30 performs an address translation between FBUS microengine transfer 
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register locations and core processor addresses (i.e., ASB bus) so that the core processor 
20 can access registers belonging to the microengines 22a-22c. 

Although microengines 22 can use the register set to exchange data as 
described below, a scratchpad memory 27 is also provided to permit microengines to 
5 write data out to the memory for other microengines to read. The scratchpad 27 is 
coupled to bus 34. 

The processor core 20 includes a RISC core 50 implemented in a five 
stage pipeline performing a single cycle shift of one operand or two operands in a single 
cycle, provides multiplication support and 32 bit barrel shift support. This RISC core 50 

10 is a standard Strong Ann® architecture but it is implemented with a five stage pipeline 
for performance reasons. The processor core 20 also includes a 16 kilobyte instruction 
cache 52, an 8 kilobyte data cache 54 and a prefetch stream buffer 56. The core processor 
20 performs arithmetic operations in parallel with memory writes and instruction fetches. 
The core processor 20 interfaces with other functional units via the ARM defined ASB 

15 bus. The ASB bus is a 32-bit bi-directional bus 32. 

Referring to FIG. 3, an exemplary microengine 22f includes a control store 
70 that includes a RAM which stores a microprogram. The microprogram is loadable by 
the core processor 20. The microengine 22f also includes controller logic 72. The 
controller logic includes an instruction decoder 73 and program counter (PC) units 72a- 

20 72d. The four micro program counters 72a- 72d are maintained in hardware. The 

microengine 22f also includes context event switching logic 74. Context event logic 74 
receives messages (e.g., SEQ_#_EVENT_RESPONSE; FBI_EVENT_RESPONSE; 
SRAM _EVENT_RESPONSE; SDRAM _EVENT_RESPONSE; and ASB 
_EVENT RESPONSE) from each one of the shared resources, e.g., SRAM 26a, SDRAM 

25 26b, or processor core 20, control and status registers, and so forth. These messages 

provide information on whether a requested function has completed. Based on whether or 
not a function requested by a thread has completed and signaled completion, the thread 
needs to wait for that completion signal, and if the thread is enabled to operate, then the 
thread is placed on an available thread list (not shown). The microengine 22f can have a 

30 maximum of e.g., 4 threads available. 

In addition to event signals that are local to an executing thread, the 
microengines 22 employ signaling states that are global. With signaling states, an 
executing thread can broadcast a signal state to all microengines 22. Receive Request 
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Available signal, Any and all threads in the microengines can branch on these signaling 
states. These signaling states can be used to determine availability of a resource or 
whether a resource is due for servicing. 

The context event logic 74 has arbitration for the four (4) threads. In one 
5 embodiment, the arbitration is a round robin mechanism. Other techniques could be used 
including priority queuing or weighted fair queuing. The microengine 22f also includes 
an execution box (EBOX) data path 76 that includes an arithmetic logic unit 76a and 
general purpose register set 76b. The arithmetic logic unit 76a performs arithmetic and 
logical functions as well as shift functions. The arithmetic logic unit includes condition 

10 code bits that are used by instructions described below. The registers set 76b has a 
relatively large number of general purpose registers that are windowed as will be 
described so that they are relatively and absolutely addressable. The microengine 22f 
also includes a write transfer register stack 78 and a read transfer stack 80. These registers 
are also windowed so that they are relatively and absolutely addressable. Write transfer 

1 5 register stack 78 is where write data to a resource is located. Similarly, read register stack 
80 is for return data from a shared resource. Subsequent to or concurrent with data 
arrival, an event signal from the respective shared resource e.g., the SRAM controller 
26a, SDRAM controller 26b or core processor 20 will be provided to context event arbiter 
74 which will then alert the thread that the data is available or has been sent. Both 

20 transfer register banks 78 and 80 are connected to the execution box (EBOX) 76 through 
a data path. 

Referring to FIG. 4, the microengine datapath maintains a 5-stage micro- 
pipeline 82. This pipeline includes lookup of microinstruction words 82a, formation of 
the register file addresses 82b, read of operands from register file 82c, ALU, shift or 

25 compare operations 82d, and write-back of results to registers 82e. By providing a write- 
back data bypass into the ALU/shifter units, and by assuming the registers are 
implemented as a register file (rather than a RAM), the microengine can perform a 
simultaneous register file read and write, which completely hides the write operation. 

The instruction set supported in the microengines 22a-22f support 

30 conditional branches. The worst case conditional branch latency (not including jumps) 
occurs when the branch decision is a result of condition codes being set by the previous 
microcontrol instruction. The latency is shown below in Table 1 : 
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TABLE 1 



I 1 | 2 | 3 J 4 | 5| 6| 7| 8| 
: — + — H — + — + — + — + — + — + + 

microstore lookup | nl | cb | n2 | XX | bl | b2 | b3 | b4 1 
regaddrgen | | nl | cb | XX | XX| bl | b2 | b3 | 
regfilelookup | | | nl | cb | XX | XX | bl | b2 1 
ALU/shifter/cc | | | | nl | cb | XX | XX | bl | 
writeback | | | m 2| | nl | cb | XX |XX | 

where nx is pre-branch microword (nl sets cc's) 
cb is conditional branch 
bx is post-branch microword 
XX is aborted microword 



As shown in Table 1, it is not until cycle 4 that the condition codes of nl 
are set, and the branch decision can be made (which in this case causes the branch path to 
be looked up in cycle 5). The microengine 22f incurs a 2-cycle branch latency penalty 
because it must abort operations n2 and n3 (the 2 microwords directly after the branch) in 
the pipe, before the branch path begins to fill the pipe with operation bl. If the branch is 
not taken, no microwords are aborted and execution continues normally. The 
microengines have several mechanisms to reduce or eliminate the effective branch 
latency. 

The microengines support selectable deferred branches. Selectable 
deferring branches are when a microengine allows 1 or 2 micro instructions after the 
branch to execute before the branch takes effect (i.e. the effect of the branch is "deferred" 
in time). Thus, if useful work can be found to fill the wasted cycles after the branch 
microword, then the branch latency can be hidden. A 1 -cycle deferred branch is shown 
below in Table 2 where n2 is allowed to execute after cb, but before bl : 
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TABLE 2 

| 1 1 2 | 3 | 4 I 5| 6| 1\ 8| 

microstore lookup | nl | cb | n2 | XX | bl | b2 | b3 | b4 | 
regaddrgen | | nl | cb | n2 1 XX |bl | b2 1 b3 | 
reg file lookup | | | nl | cb | n2 | XX | bl | b2 | 
ALU/shifter/cc | | | | nl | cb | n2 | XX | bl | 
writeback | | | | | nl | cb | n2 | XX | 

A 2-cycle deferred branch is shown in TABLE 3 where n2 and n3 are both 
allowed to complete before the branch to bl occurs. Note that a 2-cycle branch deferment 
is only allowed when the condition codes are set on the micro-word preceding the branch. 



15 TABLE 3 

I 1 1 2 | 3 | 4 1 5| 6| 7| 8| 9| 

: + + + + + + + + + + 



10 



microstore lookup | nl | cb | n2 | n3 | bl | b2 | b3 | b4 | b5 | 
20 reg addr gen | | nl | cb | n2 | n3 | bl | b2 | b3 | b4 | 

reg file lkup | | | nl | cb | n2 1 n3 | bl | b2 | b3 | 
ALU/shftr/cc | | | | nl | cb | n2 | n3 | bl | b2 | 
writeback | | | | | nl | cb | n2 | n3 | bl | 

25 The microengines also support condition code evaluation. If the condition 

codes upon which a branch decision are made are set 2 or more microwords before the 
branch, then 1 cycle of branch latency can be eliminated because the branch decision can 
be made 1 cycle earlier as in Table 4. 
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TABLE 4 
| 1| 2| 3| 4| 5| 6| 1\ 8| 

microstore lookup | nl | n2 | cb | XX | bl | b2 | b3 | b4 | 

regaddrgen | | nl | n2 | cb | XX | bl | b2 | b3 | 

regfilelookup | | | nl | n2 | cb | XX | bl | b2 | 

ALU/shifter/cc | | | | nl | n2 | cb | XX | bl | 
10 writeback | | | | | nl | n2 1 cb | XX | 

In this example, nl sets the condition codes and n2 does not set the 
conditions codes. Therefore, the branch decision can be made at cycle 4 (rather than 5), 
to eliminate 1 cycle of branch latency. In the example in Table 5 the 1 -cycle branch 
deferment and early setting of condition codes are combined to completely hide the 
15 branch latency. That is, the 

condition codes (cc ! s) are set 2 cycles before a 1 -cycle deferred branch. 

TABLE 5 
| 1 | 2 | 3 | 4 | 5| 6| 7| 8| 

20 + — + — + — + — + — + — + — + — + 

microstore lookup | nl | n2 | cb | n3 | bl | b2 | b3 | b4 | 
regaddrgen | | nl | n2 | cb | n3 | bl | b2 | b3 | 
regfilelookup | | | nl | n2 | cb | n3 | bl | b2 | 
ALU/shifter/cc | | | | nl | n2 | cb | n3 | bl | 
25 writeback | | | | | nl | n2 1 cb | n3 1 

In the case where the condition codes cannot be set early (i.e. they are set 
in the microword preceding the branch), the microengine supports branch guessing which 
attempts to reduce the 1 cycle of exposed branch latency that remains. By "guessing" the 
30 branch path or the sequential path, the microsequencer pre- fetches the guessed path 1 
cycle before it definitely knows what path to execute. If it guessed correctly, 1 cycle of 
branch latency is eliminated as shown in Table 6. 
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TABLE 6 

guess branch taken /branch is taken 

| 1| 2| 3| 4| 5| 6| 7| 8| 

microstore lookup | nl | cb | nl | bl [ b2 | b3 | b4 | bS | 
regaddrgen | | nl | cb j XX | bl | b2 1 b3 | b4 1 
reg file lookup | | | nl | cb | XX | bl | b2 | b3 | 
ALU/shifter/cc | | | | nl | cb | XX | bl | b2 1 
writeback | | | | | nl | cb | XX | bl | 

If the microcode guessed a branch taken incorrectly, the microengine still only wastes 1 
cycle as in TABLE 7 

TABLE 7 

guess branch taken /branch is NOT taken 

| 1| 2| 3| 4| 5| 6| 7| 8| 
+ — + — + — + — + 1- — + — + — + 

microstore lookup | nl | cb j nl | XX | n2 | n3 | n4 | n5 | 
reg addr gen | | nl | cb | nl | XX | n2 | n3 | n4 1 
reg file lookup | | | nl | cb | nl | XX | n2 | n3 | 
ALU/shifter/cc | | | | nl | cb | nl | XX | n2 | 
writeback III! | nl | cb | nl | XX | 



However, the latency penalty is distributed differently when microcode 
guesses a branch is not taken. For guess branch NOT taken / branch is NOT taken there 
are no wasted cycles as in Table 8. 
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Table 8 

I 1 | 2| 3| 4| 5| 6| 7| 8| 
: + — + — 4 — + — + — + — + — + — + 

microstore lookup | nl | cb | nl | n2 1 n3 | n4 1 n5 | n6 1 
regaddrgen | | nl | cb | nl |n2 1 n3 | n4 |n5 | 
reg file lookup | | | nl | cb | nl | n2 | nl | b4 | 
ALU/shifter/cc | | | | nl | cb | nl | n2 | n3 | 
write back | | | | | nl | cb | nl | n2 | 

However for guess branch NOT taken /branch is taken there are 2 wasted 
cycles as in Table 9. 



Table 9 



| 1 | 2 | 3 | 4 | 5| 6| 7| 8| 

microstore lookup | nl | cb | nl | XX | bl | b2 | b3 | b4 1 
regaddrgen | | nl | cb | XX | XX | bl | b2 | b3 | 
reg file lookup | | |nl |cb|XX|XX|bl |b2| 
ALU/shifter/cc | | | | nl | cb | XX | XX | bl | 
writeback | | | | | nl I cb I XX I XX I 



The microengine can combine branch guessing with 1-cycle branch deferment to improve 
the result further. For guess branch taken with 1-cycle deferred branch/branch is taken is 
in Table 10. 



10 



WO 01/16713 



PCT/US00/24006 



Table 10 
| 1| 2 | 3 J 4 1 5| 6| 1\ 8| 

t 

microstore lookup | nl | cb | n2 | bl | b2 | b3 | b4 | b5 | 
regaddrgen | |nl|cb|n2|bl |b2|b3|b4| 
regfilelookup | | |nl |cb |n2 | bl | b2 |b3 | 
ALU/shifter/cc | | | | nl | cb | n2 | bl | b2 | 
10 writeback | | | | | nl | cb | n2 1 bl | 

In the case above, the 2 cycles of branch latency are hidden by the execution of n2, and 
by correctly guessing the branch direction. 

If microcode guesses incorrectly, 1 cycle of branch latency remains 
15 exposed as in Table 1 1 (guess branch taken with 1 -cycle deferred branch/branch is NOT 
taken). 

Table 11 

20 | 1| 2| 3| 4| 5| 6| 7| 8| 9| 

+ — + — + — + — + — + — + — + — + — + 

microstore lookup | nl | cb | n2 | XX | n3 | n4 | n5 | n6 | n7 | 
reg addr gen | | n 1 | cb | n2 | XX | n3 | n4 | n5 | n6 | 
regfilelkup | | | nl | cb | n2 | XX | n3 | n4 | n5 | 
25 ALU/shftr/cc | | | | nl | cb | n2 | XX | n3 | n4 | 

writeback I I I I I nl | cb | n2 | XX | n3 | 



If microcode correctly guesses a branch NOT taken, then the pipeline 
30 flows sequentially in the normal unperturbed case. If microcode incorrectly guesses 

branch NOT taken, the microengine again exposes 1 cycle of unproductive execution as 
shown in Table 12. 



11 



WO 01/16713 



PCT/USOO/24006 



Table 12 



guess branch NOT taken/branch is taken 

| 1 1 2 | 3 | 4 | 5| 6| 7| 8| 9| 
+ — + (. — + — + — + — + ___ + — + 

microstore lookup | nl | cb | n2 | XX | bl | b2 | b3 | b4 | b5 | 
regaddrgen | | nl | cb | n2 | XX | bl | b2 1 b3 | b4 J 
regfilelkup | | | nl | cb | n2 | XX | bl | b2 | b3 | 
ALU/shftr/cc | I I I nl | cb | n2 | XX | bl | b2 | 
writeback | | | | | nl | cb | n2 | XX | bl | 

where nx is pre-branch microword (nl sets cc's) 
cb is conditional branch 
bx is post-branch microword 
XX is aborted microword 
In the case of a jump instruction, 3 extra cycles of latency are incurred 
because the branch address is not known until the end of the cycle in which the jump is in 
the ALU stage (Table 13). 

Table 13 



| 1 | 2 | 3 | 4 | 5| 6| 7| 8| 9| 

microstore lookup | nl | jp | XX | XX | XX | jl | j2 | j3 | j4 | 
regaddrgen | | nl | jp | XX | XX | XX | jl | j2 | j3 | 
regfilelkup | | | nl | jp | XX | XX | XX |jl | j2 | 
ALU/shftr/cc | | | | nl | jp | XX | XX | XX | jl | 
writeback | | | | | nl | jp | XX | XX | XX | 



Conditional branches that operate on ALU condition codes which are set 
on the microword before the branch can select 0, 1 or 2 or 3 cycle branch deferment 
modes. Condition codes set 2 or more microwords before the conditional branch that 
operates on them can select 0 or 1 -cycle branch deferment modes. All other branches 
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(including context rearbitrations) can select either 0 or 1 -cycle branch deferment modes. 
The architecture could be designed to make a context arbitration microword within a 
branch deferment window of a preceding branch, jump or context arbitration microword, 
an illegal option. That is, in some embodiments, a context switch would not be allowed 
5 to occur during a branch transition in the pipeline because it could unduly complicate 
saving of the old context PC. The architecture could also be designed to make branching 
within the branch deferment window of a preceding branch, jump or context arbitration 
microword illegal to avoid complicated and possible unpredictable branch behaviors. 

Referring to FIG. 5 A, general formats for branch instructions are shown. 
1 0 Branch Instructions 

BR BR<0, BR=0 BR<=0. BRNO BR=COUT, BR>0 BRNCOUT, BR>=0 

One set of branch instructions are branch unconditionally BR or branch to 

an instruction at a specified label based on an ALU condition code. Exemplary ALU 

condition codes are Sign, Zero, and Carryout (cout). 
1 5 Formats: br[label#], optional_token 

br=0[label#], optionaljoken 

br!=0[label#], optionaljoken 

br>0[label#], optionaljoken 

br>=0[label#], optionaljoken 
20 br<0[label#], optionaljoken 

br<=0[label#], optionaljoken 

br=cout[label#], optionaljoken 

br!=cout[label#], optionaljoken 

The parameter label# is a symbolic label corresponding to the address of 
25 an instruction. This class of branch instructions can have the following optional Jokens; 

defer one instruction, defer two instructions, and defer three instructions. These optional 

tokens cause the processor to execute one, two, or three instructions following this 

instruction before performing the branch operation. The ALU operation that sets the 

condition codes may occur several instructions before the branch instruction. The defer 
30 two and defer three are not used with branch guess as described below 

A fourth optional token is the guess J>ranch token which causes the 

processor to prefetch the instruction for the "branch taken" condition rather than the next 
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sequential instruction. The ALU operation that sets the condition codes occurs 
immediately before the branch instruction. 

BR_BCLR; BRBSET 

A second set of branch instructions is the branch to a specific label when a 
specified bit is set or cleared. These instructions set condition codes in the processor 
status register. The instruction formats are br_bclr[reg, bit_position, label#], 
optionaljoken; brj>set[reg, bit josition, label#], 
optional_token 

The operand field Reg A is a context-relative transfer register or general- 
purpose register that holds the operand. Bitjosition A is a number specifying a bit 
position in a longword. Bit 0 is the least significant bit. Valid bitjosition values are 0 
through 31. Label# is the symbolic label corresponding to the address of a target 
instruction. 

This set of branch instructions also has the optional_tokens; defer one 
instruction, defer two instructions, and defer three instructions branch guess, as described 
above. 

Example: br_bclr[reg, bitjosition, label#], defer [1] Branch if bit is clear. 

BR=BYTE; BR!=BYTE 

A third set of branch instructions are instructions that cause the processor 
to branch to the instruction at a specified label if a specified byte in a longword matches 
or mismatches a byte jompare_value. The br=byte instruction prefetches the instruction 
for the "branch taken" condition rather than the next sequential instruction. The br!=byte 
instruction prefetches the next sequential instruction. These instructions set the condition 
codes. 

Format br=byte[reg, byte_spec, byte _compare_value, label#], optionaljoken 

br!=byte[reg, byte_spec, byte_compare_value, label#], optionaljoken 
Reg A is the context-relative transfer register or general-purpose register 
that holds the operand. Byte_spec Number is a number specifying a byte in register to be 
compared with byte_compare_value. Valid byte_spec values are 0 through 3. A value of 
0 refers to the rightmost byte. Byte jompare^value is a parameter used for comparison. 
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In this implementation, valid byte_compare_values are 0 to 255. Label# is the symbolic 
label corresponding to the address of an instruction. 

This set of branch instructions also has the optionaljokens; defer one 
instruction, defer two instructions, defer three instructions, and branch guess. Also deter 
two and three are only used with the BR!=BYTE. 
Example: br!=byte[reg, byte_spec, byte_compare_value, 
label #], defer[3] 

This microword instruction provides a technique for comparing an aligned 
byte of a register operand to an immediate specified byte value, where byte_spec 
represents the aligned byte to compare (0 is right-most byte, 3 is leftmost byte). The ALU 
condition codes are set by subtracting the specified byte value from the specified register 
byte. If the values match, the specified branch is taken. There is a 3 cycle branch latency 
associated with this instruction therefore, branch deferments of 0, 1, 2 or 3 are allowed in 
order to fill the latency with useful work. The register can be an A or B bank register. 
CTXARB 

Referring to FIG. 5B, the context swap instruction CTX_ARB swaps a 
currently running context in a specified microengine out to memory to let another context 
execute in that microengine. The context swap instruction CTX_ARB also wakes up the 
swapped out context when a specified signal is activated. The format for the context 
swap instruction is: 

ctx_arb[parameter], optional_token 

The "parameter" field can have one of several values. If the parameter is 
specified as "sram Swap", the context swap instruction will swap out the current context 
and wake it up when the thread's SRAM signal is received. If the parameter is specified 
as "sram Swap", the context swap instruction will swap out the current context and wake 
it up when the thread's SDRAM signal is received. The parameter can also be specified 
as "FBI" and swap out the current context and wake it up when the thread's FBI signal is 
received. The FBI signal indicates that an FBI CSR, Scratchpad, TFEFO, or RFEFO 
operation has completed. 

The parameter can also be specified as 
"secLJiuml j;hange/seq_num2_change", which swaps out the current context and wakes 
it up when the value of the sequence number changes. The parameter can be specified as 
"interjhread" which swaps out the current context and wakes it up when the threads 
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interthread signal is received, or "voluntary" which will swap out the current context if 
another thread is ready to run, otherwise do not swap. If the thread is swapped, it is 
automatically re-enabled to run at some subsequent context arbitration point. The 
parameter can be "auto_j>ush" which swaps out the current context and wakes it up when 
5 SRAM transfer read register data has been automatically pushed by the FBus interface, or 
a "startjeceive" that swaps out the current context and wake it up when new packet data 
in the receive FIFO is available for this thread to process. 

The parameter can also be •■kill" which prevents the current context or 
thread from executing again until the appropriate enable bit for the thread is set in a 
10 CTXJENABLES register, "pci" which swaps out the current context and wake it up when 
the PCI unit signals that a DMA transfer has been completed. 

The context swap instruction CTX_ARB can have the following 
optionaMoken, defer one which specifies that one instruction will be executed after this 
reference before the context is swapped. 
15 BR=CTX, BR!=CTX 

Referring to FIG. 5C, context branch instructions BR=CTX, BR!=CTX are 
shown. The context branch instruction causes a processor, e.g., microengine 22f to 
branch to an instruction at a specified label based on whether or not the current executing 
context is the specified context number. As shown in FIG. 5C, the context branch 
20 instruction is determined from the branch mask fields when equal to "8" or "9." The 
context branch instruction can have the following format: 
Format: br=ctx[ctx, label#], optionaMoken 
br!=ctx[ctx, label#], optionaljoken 

Label# is a symbolic label corresponding to the address of an instruction. 
25 Ctx Context number is the number of a context (thread). In this example, valid ctx values 
are 0, 1,2, or 3. 

This instruction has an optional token "defer one" instruction which causes 
the processor to execute the instruction following this instruction before performing the 
branch operation. 
30 BR_INP_STATE 

Referring back to FIG. 5 A, another class of branch instructions causes the 
processor to branch if the state of a specified state name is set to 1 . A state is set to 1 or 0 
by a microengine in the processor and indicates the currently processing state. It is 
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available to all microengines. A format as shown in FIG. 5 uses br_mask field is used to 
specify branch. For branch mask = 15, the extended field is used to specify the 
various signal and state signals as listed below. 
Format: br_inp_state[state_name, label#], optional_token 
5 Label# is a symbolic label corresponding to the address of an instruction. 

State_name is the state name, if rec_req_avail when set, it indicates that the RCVREQ 
FIFO has room available for another receive request. If push_protect, when set, it 
indicates that the FBI unit is currently writing to the SRAM transfer registers. This 
instruction can also have an optional Joken "defer one" which executes the instruction 
10 following this instruction before performing the branch operation. 

BR_! SIGNAL 

Another class of branch instruction causes the processor to branch if a 
specified signal is deasserted. If the signal is asserted, the instruction clears the signal and 

15 does not take the branch. The SRAM and SDRAM signals are presented to the 

microengine two cycles after the last Long word is written to the transfer register. The 
second from last Long word is written 1 cycle after the signal. All other Long words are 
valid when the signal is submitted. With this instruction, the programmer times the 
reading of transfer registers appropriately to ensure that the proper data is read. 

20 Format: br_signal[signal_name, label#], optionaMoken 

Label# is a symbolic label corresponding to the address of an instruction. 
Signal_name can be sram, sdram, fbi, pci, interjhread, auto_push start_receive, 
seq_num 1 , seq__num2 . 

This set of branch instructions has the following optionaMokens defer one 

25 instruction, defer two instructions, and defer three instructions. These optional tokens 
cause the processor to execute one, two, or three instructions following this instruction 
before perfonning the branch operation. The ALU operation that sets the condition codes 
may occur several instructions before the branch instruction. The defer two and defer 
three are not used with branch guess. 

30 A fourth optional token is the guess_branch Prefetch. The guess branch 

prefetch token prefetches the instruction for the "branch taken" condition rather than the 
next sequential instruction. This token is used with defer one instruction to improve 
performance. 

17 



WO 01/16713 



PCT/US00/24006 



Example: .xfer_order SxferO Sxferl $xfer2 $xfer3 
sram[read, SxferO, opl, 0, 2], sig_done 
wait#: 

br_!signal[sram, wait#], guess_branch 
nop;delay 1 cycle before reading SxferO 
alu[gprO,0,b,$xferO];valid data is written to gprO 
alu[gprl,0,b,$xferl];valid data is written to gprO 
self#: 
br[self»]. 

Referring to FIG. 6, the two register address spaces that exist are Locally 
accessibly registers, and Globally accessible registers accessible by all microengines. 
The General Purpose Registers (GPRs) are implemented as two separate banks (A bank 
and B bank) whose addresses are interleaved on a word-by-word basis such that A bank 
registers have lsb=0, and B bank registers have lsb=l. Each bank is capable of 
performing a simultaneous read and write to two different words within its bank. 

Across banks A and B, the register set 76b is also organized into four 
windows 76bo-76b3 of 32 registers that are relatively addressable per thread. Thus, 
thread_0 will find its register 0 at 77a (register 0), the thread_l will find its register_0 at 
77b (register 32), thread_2 will find its registerj) at 77c (register 64), and thread_3 at 77d 
(register 96). Relative addressing is supported so that multiple threads can use the exact 
same control store and locations but access different windows of register and perform 
different functions. The use of register window addressing and bank addressing provide 
the requisite read bandwidth while using only dual ported RAMS in the microengine 22f. 

These windowed registers do not have to save data from context switch to 
context switch so that the normal push and pop of a context swap file or stack is 
eliminated. Context switching here has a 0 cycle overhead for changing from one context 
to another. Relative register addressing divides the register banks into windows across 
the address width of the general purpose register set. Relative addressing allows access 
any of the windows relative to the starting point of the window. Absolute addressing is 
also supported in this architecture where any one of the absolute registers may be 
accessed by any of the threads by providing the exact address of the register. 

Addressing of general purpose registers 78 can occur in 2 modes 
depending on the microword format. The two modes are absolute and relative. In 
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absolute mode, addressing of a register address is directly specified in 7-bit source field 
(a6-a0 or b6-b<3), as shown in Table 14: 

Table 14 

7 6 5 4 3 2 1 0 
+._+_.+_+_+_.+ — h— +— + 

A GPR: |a6|0|a5|a4|a3|a2|al|a0| a6=0 
BGPR: |b6| 1 |b5|b4|b3|b2|bl|b0| b6=0 

SRAM/ASB:|a6|a5|a4|0|a3|a2|al|aO| a6=l, a5=0, a4=0 SDRAM: 
| a6| aS| a4| 0 | a3| a2| al| a0| a6=l, a5=0, a4=l 

register address directly specified in 8-bit dest field (d7-d0) Table 15: 

Table 15 

7 6 5 4 3 2 1 0 
+ — + — +._.+ — + — h — + — + — i- 

A GPR: | d7| d6| d5| d4| d3| d2| dl| d0| d7=0, d6=0 
B GPR: | d7| d6| d5| d4| d3| d2| dl| d0| d7=0, d6=l 
SRAM/ASB:| d7| d6| dS| d4| d3| d2| dl| d0| d7=l, d6=0, d5=0 
SDRAM: | d7| d6| dS| d4| d3| d2| dl| d0| d7=l, d6=0, d5=l 

If <a6:a5>=l,l, <b6:b5>=l,l, or <d7:d6>=l,l then the lower bits are 
interpreted as a context-relative address field (described below). When a non-relative A 
25 or B source address is specified in the A, B absolute field, only the lower half of the 
SRAM/ASB and SDRAM address spaces can be addressed. Effectively, reading 
absolute SRAM/SDRAM devices has the effective address space; however, since this 
restriction does not apply to the dest field, writing the SRAM/SDRAM still uses the full 
address space. 

30 In relative mode, addresses a specified address is offset within context 

space as defined by a 5-bit source field (a4-a0 or b4-b0)Table 16: 
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Table 16 

7 6 5 4 3 2 1 0 
+ — + — + — + — + — + — +„.+ — + 

A GPR: | a4| 0 |context| a3| a2| al| a0| a4=0 
B GPR: | b4| 1 |context| b3| b2| bl | b0| b4=0 
SRAM/ASB:|ab4| 0 |ab3|context| b2| bl|abO| ab4=l, ab3=0 
SDRAM: |ab4| 0 |ab3|context| b2| bl|ab0| ab4=l, ab3=l 

or as defined by the 6-bit dest field (d5-d0) Table 17: 

Table 17 

7 6 5 4 3 2 1 0 

+ — + — + — + — + — + — + — + — + 

A GPR: |d5|d4|context|d3|d2|dl|d0| d5=0, d4=0 
B GPR: |d5|d4|context|d3|d2|dl|d0| d5=0,d4=l 
SRAM/ASB:| d5| d4| d3|context| d2| dl| d0| d5=l, d4=0, d3=0 
SDRAM: 1 d5| d4| d3|context| d2| dl| d0| d5=l, d4=0, d3=l 

If <d5:d4>=l,l, then the destination address does not address a valid 
register, thus, no dest operand is written back. 

Other embodiments are within the scope of the following claims. 
What is claimed is: 



20 



WO 01/16713 



PCT/USOO/24006 



1 . A computer instruction comprises: 

a branch instruction that causes a branch in execution of an instruction 
stream based on any specified value being true or false and including a token that 
specifies the number of instructions in the instruction stream that are after the instruction 
to execute before performing the branch operation. 

2. The instruction of claim 2 wherein the branch instruction includes a 
second token that specifies a branch guess operation. 

3. The instruction of claim 1 wherein the optional token includes 

deferj which causes the processor to execute the i th instruction following 
the branch instruction before performing the branch operation. 

4- The instruction of claim 1 wherein the optional token can specify, one, two 
or three instructions following branch instruction to execute before performing the branch 
operation. 

5- The instruction of claim 1 wherein the instruction has a format as: 

br [label#], optionaMoken, 
where br refers to a branch operation, label# is a symbolic representation 
of an address to branch to and option_token specifies the number of instructions to 
execute before performing the branch operation specified by the br branch instruction. 

6. The instruction of claim 1 wherein one of the optional tokens are specified 
by a programmer or assembler program to enable variable cycle deferred branching. 

7. The instruction of claim 1 wherein one of the optional tokens are specified 
to assist an assembler program to produce more efficient code, 

8- The instruction of claim 1 wherein the branch instruction is a branch 

unconditionally or branch to an instruction at a specified label based on an ALU condition 
code. 
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9. The instruction of claim 1 wherein the instruction is a branch to a specific 
label when a specified bit is set or cleared. 

10. - The instruction of claim 1 wherein the branch instruction is a branch 

5 instruction that causes the processor to branch to the instruction at a specified label if a 
specified byte in a longword matches or mismatches a byte_compare_value. 

11- The instruction of claim 1 wherein the branch instruction is a branch 

instruction that causes the processor to branch to the instruction at a specified label based 
10 on whether or not a current context is a specified context in the branch instruction. 

12. The instruction of claim 1 wherein the branch instruction a branch 
instruction that causes the processor to branch if the state of a specified state name is a 
selected value. 

15 

13. The instruction of claim 1 wherein the branch instruction a branch 
instruction that causes the processor to branch if a specified signal is deasserted. 

14. The instruction of claim 1 wherein the branch instruction further includes 
20 an additional token, a guess_branch token which causes the processor to prefetch the 

instruction for the "branch taken" condition rather than the next sequential instruction. 

15. A computer program comprising: 

a plurality of instructions to cause a processor to execute computer 
25 instructions to perform a function, said program having a second plurality of branch 
instructions in different parts of the program that include different defer branch tokens 
where the branch tokens specify the number of instructions to execute before performing 
branch operations specified by the second plurality of branch instructions. 

30 16. The product of claim 15 wherein at least one the branch instructions 

further includes an additional token, a guess__branch token which causes the processor to 
prefetch the instruction for the "branch taken" condition rather than the next sequential 
instruction. 
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17. A method of operating a processor comprises: 

executing a branch instruction that causes a branch in an instruction stream 
based on any specified value being true or false; and 

deferring performance of the branch operation of the branch instruction 
based on evaluating a token that specifies the number of instructions to execute before 
performing the branch operation. 

18. The method of claim 1 7 further comprising: 

evaluating a second token that specifies a branch guess operation, which 
causes the processor to prefetch the instruction for the "branch taken" condition rather 
than the next sequential instruction. 

19. The method of claim 17 wherein the optional token is selectable by a 
programmer. 

20. The method of claim 17 wherein the optional token is specified by a 
programmer or assembler program to enable variable cycle deferred branching. 

21 . The method of claim 17 wherein one of the optional token is specified to 
assist an assembler program to produce more efficient code. 
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